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DIGITAL DATA INSERTION APPARATUS AND METHODS FOR USE WITH 
COMPRESSED AUDIOA^IDEO DATA 

FIELD OF THE DISCLOSURE 
[0001] The present disclosure relates generally to the delivery and distribution of 
compressed digital audio/video content such as digital broadcast systems and, more 
specifically, to digital data insertion apparatus and methods for use with compressed 
audio/video data. 

BACKGROUND 

[0002] Digital broadcast systems have undergone rapid development and 
deployment in recent years due, at least in part, to their ability to efficiently distribute 
large numbers of high-fidelity video and/or audio programs, as well as other digital 
services or programs, over a large geographic region. For example, in the case of 
satellite-based digital television and audio broadcast systems, little, if any, land-based 
infi-astructure (e.g., ground stations, cable lines, etc.) is needed to provide services to 
subscribers on a world-wide basis. As a result, such satellite-based systems enable 
digital broadcasters and content providers to develop markets for their programs 
and/or services in remote and/or underdeveloped regions of the world in a cost- 
effective manner. 

[0003] In general, regardless of whether a digital broadcast system uses one or 
more satellites, cable transmission lines, ground-based wireless transmission stations, 
or any combination thereof, such a system enables users to receive high-fidelity video 
and/or audio programs, as well as user-interactive features or tools such as, for 
example, pictographic program guides, grid-based guides, etc. that enable users to 
plan and carry out program consumption activities. Digital broadcast systems 
typically transmit one or more high-bandwidth signals, each of which is typically 
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composed of a stream of data or data packets having a plurality of video, audio and/or 
other digital programs or content multiplexed therein. A number of well-known data 
compression techniques (e.g., audio/video content compression techniques), 
transmission protocols and the like are typically employed to generate and transmit a 
multi-program data stream or bitstream, which is commonly referred to as a transport 
stream. In particular, digital television programming is typically transmitted 
according to a standard promulgated by the Advanced Television Standards 
Committee (ATSC). The ATSC standard is a comprehensive standard relating to the 
conveyance of digital television signals. Under the ATSC standard, video 
information associated with a program is encoded and compressed according to the 
well-known Moving Pictures Expert Group-2 (MPEG-2) standard and audio 
information associated with the program is encoded and compressed according to the 
well-known AC-3 standard. As a result, an ATSC data stream or bit stream contains 
video information in the form of MPEG-2 packets and audio information in the form 
of AC-3 packets. However, other digital transmission protocols, data compression 
schemes and the like may be used instead. 

[0004] In the case of freely available digital audio/video content or programming, 
users must have a television adapted to receive and process digital television signals 
(e.g., a high definition television). In the case of purchased digital audio/video 
content or progranmiing, subscribers typically have a digital decoder unit which, in 
the case of a digital video or television system, is commonly referred to as a "set-top 
box," that receives and processes multi-program data streams or transport streams and 
outputs video and audio signals to a television, video monitor, speakers, etc. for 
consumption by the user. In particular, the set-top box can, based on subscriber 
commands, extract data packets associated with a particular program or portion of 

2 
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audio/video content from a particular data stream or transport stream, decode those 
extracted data packets and send video and/or audio signals to a television, video 
monitor, digital radio, etc. for consumption by a user. 

(0005] As is the case with analog content providers and broadcasters, digital 
content providers and broadcasters (e.g., digital television broadcasters, digital audio 
broadcasters, etc.) often desire to verify the transmission and/or to meter (i.e., . 
monitor) the consumption of the audio/video content or programs and/or other 
services provided to subscribers. In this manner, a broadcaster can generate broadcast 
verification information and/or audience program consumption behavior or patterns. 
Audience consximption behavior or patterns may be used in conjunction with 
demographic information to develop ratings information, to improve targeted 
marketing or advertising campaigns, to improve the types of programs or audio/video 
content and/or services and the times at which those programs and/or services are 
delivered to consumers, to assess the value of a particular time slot and program for 
purposes of determining what advertisers should pay for usage of that time slot, etc. 
[0006J With known analog television metering systems, viewing records or other 
viewing information is typically collected from a group of statistically selected 
households. As with digital broadcast systems, each of the statistically selected 
households has a data logging and processing unit (i.e., "home unit" or "site unit"). 
The site unit is usually coupled to a variety of attachments that provide inputs to the 
site unit or that receive outputs from the site unit. For example, an analog system may 
include a frequency detector to detect the local oscillator frequency of a television to 
identify the channel to which the television is currently tuned. Also, for example, a 
people counter, may be located in the viewing space of the television and may be in 
communication with the site unit, thereby enabling the site unit to actively or 
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passively detect the identities of the persons currently viewing programs presented by 
the television. 

[0007] The site unit usually processes its inputs, including the inputs from its 
attachments, to produce viewing records. The viewing records typically contain 
audio/video content or program identification information (i.e., information that can 
be used to identify a particular program or portion of audio/video content, such as 
channel information obtained from the frequency detector) and audience information. 
The audience information may include the numbers and/or identities of persons 
viewing a particular program, demographic information, etc. The viewing records 
may be generated on a periodic basis (i.e., at fixed time intervals) or may be generated 
in response to a change in an input such as, for example, a change in the identities or 
number of persons viewing the television, a change in the channel tuning information 
(i.e., a channel change), etc. With known analog systems, each viewing record 
typically contains channel information such as a station or channel number and a time 
(e.g., a date and time of day) at which the channel was viewed. Of course, viewing 
records may contain other information such as the identities of viewers present at the 
viewing time. 

[0008] The site unit collects a quantity of viewing records and transmits collected 
viewing records, usually daily, to a collection site, such as central office or data 
processing facility, for further processing or analysis. The data processing facility 
receives viewing records from site units located in some or all of the statistically 
selected households and analyzes the viewing records to ascertain the viewing 
behaviors of a particular household or a particular group of households selected from 
all participating households. Additionally, the central data processing facility may 



4 



wo 2004/038538 



PCT/US2003/028037 



generate viewing behavior statistics and other parameters indicative of viewing 
behavior associated with all of the participating households. 
[0009] To generate viewing behavior information from viewing records, the 
central office or data processing facility compares reference data such as a list of 
programs (i.e., a schedule of television programming or program lineup) to the 
viewing records. In this manner, the data processing facility can determine which 
programs were viewed by matching the times and channel information in the viewing 
records to the programs associated with those same times and channels in the program 
schedule or lineup. Such a matching process can be carried out for each of the 
viewing records received by the data processing facility, thereby enabling the data 
processing facility to reconstruct what programs were watched by all participating 
households and the times at which the programs were watched. 
[0010] However, known analog program metering systems (such as the television 
program verification and metering systems discussed above) are not suitable for use 
with digital broadcast systems. For example, the frequency detector attachment 
described above is not suitable for detecting digital video channel information 
because digital television systems use a data packet extraction process within a set-top 
box to retrieve audio/video data associated with a particular program, while the 
television tuner is typically allowed to remain on a single channel (e.g., typically 
channel 2 or 3). As a result, the local oscillator frequency of the television tuner is 
not indicative of (i.e., does not necessarily correspond to) the digital television 
channel currently being consumed. Thus, known analog program metering systems 
are not suitable for use with digital broadcast systems. More generally, known analog 
program metering systems cannot be used to detect the identity of broadcast digital 
programs, thereby preventing analog monitoring systems from being used to generate 
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verification information and/or viewing records that can be processed to determine 
digital program consumption behavior. 

[0011] To enable the tracking of viewing records, some digital broadcasters enable 
the identification of digital broadcast programs at home sites and one or more 
reference sites by inserting digital program identification information and/or other 
data in the video and/or audio bitstream(s). The inserted digital data is commonly 
referred to as audience measurement data, which may include signal identification 
codes (i.e., digital codes that are uniquely associated with respective audio/video 
content portions or programs), date information, time information, consumer 
identification information, etc. The insertion of audience measurement data at the 
distribution system headend or broadcast station is commonly referred to as an active 
audio/video content identification process because the system headend or broadcast 
station actively modifies (i.e., inserts data into) the transmitted bitstreams or transport 
streams. 

[0012] By actively inserting data into audio/video bitstreams in this manner, digital 
broadcasters enable the identification of digital audio/video content and the viewing 
behavior of persons viewing digital broadcasts to be readily determined. In particular, 
the site units associated with individual homes sites may be configured to extract the 
inserted audio/video content identification codes fi'om known portions or locations 
within a received bitstream and to use the extracted information to form, for example, 
viewing records. In turn, viewing records may be fiarther analyzed at each of the 
home sites and/or at one or more collection or central processing sites to generate 
viewing behavior information, ratings data, etc. 

[0013] Typically, known active data insertion techniques insert digital data within 
each of the video and/or audio signals that make up the one or more programs (i.e., 
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video and/or audio programs) being transmitted by the broadcast station before the 
individual video and/or audio signals are compressed and multiplexed to form a single 
multi-program bitstream or transport stream. However, because the digital data are 
inserted in an uncompressed domain (i.e., within the individual uncompressed 
audio/video signals), multiple digital data insertion devices (e.g., one for each 
uncompressed program bitstream) are typically required. This requirement for 
multiple digital information insertion devices is undesirable because it increases the 
complexity and operational costs associated with headend or broadcast stations. 
[0014] Another difficultly that results from inserting digital data into individual 
uncompressed program signals is that subsequent compression operations (e.g., 
compression encoding) may corrupt and/or eliminate some or all of the inserted data. 
As is known, signal compression techniques usually provide a substantial reduction in 
the quantity of data needed to reproduce a video image and/or an audio signal, but do 
so at the expense (i.e., the loss) of at least some data or information. Thus, if 
compression operations corrupt the inserted digital data, the home site and/or a central 
data processing or collection facility may not be able to accurately identify 
audio/video content. 

[0015] Still another difficulty that results from inserting digital codes or audience 
measurement data into individual uncompressed audio/video content signals is that 
the association between the inserted data or information and the program into which 
the data is inserted is limited. In particular, the inserted data may be associated with 
only the video portion of a program or only the audio portion of that same program, 
but not both the video and audio portions. This lack of association is further 
complicated by the fact that a digital broadcast station may redefine the position (e.g., 
the sub-channel or minor channel number) of an uncompressed video and/or audio 
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program within the compressed domain, or may delete one or more video and/or 
audio programs from a program lineup. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0016] Fig. 1 is a block diagram of an example system within which the data 
insertion apparatus and methods described herein may be used to identify digital 
audio/video content or programs and to generate verification information and/or 
viewing behavior information based on the identified audio/video content or 
programs. 

[0017] Fig. 2 is a block diagram of an example known system that may be used by 
the digital broadcast station of Fig. 1 to insert audience measurement data in one or 
more uncompressed audio/video content or program bitstreams. 

[0018] Fig. 3 is a block diagram of an example system that may be used within the 
digital broadcast station of Fig. 1 to insert audience measurement data in a 
compressed audio/video content or program bitstream. 

[0019] Fig. 4 is a more detailed block diagram that depicts an example manner in 

which the data inserter shown in Fig. 3 may be implemented. 

[0020] Fig. 5 is a more detailed block diagram depicting an example manner in 

which the data insertion unit of Fig. 4 may be implemented. 

[0021] Fig. 6 is a block diagram of an example processor-based system that 

executes software or instructions stored on a machine readable medium to implement 

the example data inserter shown in Fig. 3. 

[0022] Fig. 7 is a flow diagram of an example manner in which the processor 
system shown in Fig. 6 may be configured to perform the functions of the example 
data inserter shown in Fig. 3. 

8 
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[0023] Fig. 8 is a more detailed flow diagram of an example manner in which the 
data insertion block of Fig. 7 may be implemented. 

[0024] Fig. 9 is a flow diagram of an example method by which the system shown 
in Fig. 1 1 may generate viewing behavior and ratings information using data inserted 
by the example data inserter of Fig. 3. 

[0025] Fig. 10 is a block diagram of another maimer in which a data inserter may 
be configured to insert audience measurement data in a compressed audio/video 
content or program bitstream. 

DETAILED DESCRIPTION 
[0026] Fig. 1 is a block diagram of an example system 100 within which the data 
insertion apparatus and methods described in greater detail below may be used to 
identify broadcast digital audio/video content or programs and to generate viewing 
behavior and ratings information based on the identified audio/video content. The . 
system 1 00 includes a digital broadcast station 1 02 that receives digital video and/or 
audio content from a plurality of digital content providers 104 and 106. The digital 
content providers 104 and 106 may provide a variety of audio/video content such as, 
for example, television programs, advertisements, audio (e.g., radio) programs, still 
image information (e.g., web pages), etc. in known manners to the digital broadcast 
station 102. The digital broadcast station 102 transmits one or more signals 
containing digital audio/video content to a reference site 108 and at least one 
consumption site 110 via communication paths or links 112 and 1 14. TTie 
communication paths or links 1 12 and 1 14 may include any combination of hardwired 
or wireless links such as, for example, satellite links, wireless land-based links, cable 
links, etc. The signals conveyed via the links 1 12 and 114 may contain multi-program 
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data streams or bitstreams, which are often referred to as transport streams and 
commonly employed with existing digital television transmission systems. 
[0027] The reference site 108 and the consumption site 1 10 receive and process 
the digital signals or digital audio/video content provided by the digital broadcast 
station 102 using the audio/video content identification apparatus and methods 
described herein. More specifically, the reference site 108 includes a plurality of 
decoders (e.g., set-top boxes or the like) 116,118 and 1 20 that demodulate, 
demultiplex and decode audio, video and/or other data packets received fi-om the 
digital broadcast station 102. In one example, each of the decoders 116, 1 18 and 120 
provides audio and/or video data packets associated with a different program, which 
is currently being broadcast, to a reference site processor 122. In other words, the 
decoder 116 may provide data packets associated with a first program while the 
decoders 1 18 and 1 20 provide data packets associated with respective second and 
third programs. The reference site processor 122 is configured to control and/or has 
information indicating to which channel, sub-channel, etc. each of the decoders 1 16, 
1 1 8 and 120 is currently tuned. 

[0028] The reference site processor 122 may include apparatus and methods for 
extracting the data inserted by the digital broadcast station 102 into the broadcast 
audio/video content (e.g., one or more transport streams). In particular, the reference 
site processor 122 may be configured to extract digital codes and/or other data or 
information inserted by the digital broadcast station 102 firom known locations within 
data packets and/or data frames using the data insertion apparatus and methods 
disclosed herein. The reference site processor 122 may send the extracted codes 
and/or other digital information to a central processing unit 1 24 that, in turn, may 
process the extracted codes and/or other digital information to generate, for example, 
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broadcast verification information, program lineup information, or any other desired 
information relating to the audio/video content broadcast by the station 102. 
[0029] The consumption site 1 10 could be, for example, a statistically selected 
home or residence, a business location, a mobile device (e.g., a portable computer, 
cellular phone or personal data assistant, etc.) or any other site or device enabling the 
consumption of video and/or audio content or programs. For purposes of simplifying 
the discussion. Fig. 1 depicts a single system or consumption site 110. However, a 
plurality of consumption sites may be configured in manners similar or identical to 
that of the example consumption site 110. 

[0030] The consumption site 110 includes an output unit 128 such as, for example, 
a video display, television, speaker, etc. The consumption site 1 10 also includes a 
decoder (e.g., a set-top box) 130, which may be similar or identical to the decoders 
116-1 20. As shown in Fig. 1 , the decoder 130 may be serially interposed between the 
broadcast signal 114 and the output unit 128 and provides audio and/or video signals 
134 to the output unit 128 that are used to present the program currently selected for 
consumption. For example, in the case where the broadcast signal 1 1 4 is a digital 
satellite or cable television transmission, the decoder 130 demodulates extracts video 
and/or audio data packets associated with a desired channel and/or program. The 
extracted data packets are processed to form the signal 134 that can be presented (e.g., 
displayed) by the output unit 128, For example, in the case where the output unit 128 
is a television, the signal 134 may be a composite video signal, a super-video signal, a 
red, green, blue (RGB) signal, or any other displayable video signal applied to the 
appropriate input connections of the output unit 128. 

[0031] In addition, the decoder 130 also provides signals 136 containing digital 
audio/video content data to the site unit 132. The audio/video content data may, for 
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example, be digital audio signals provided using the well-known Sony Corporation 
and Philips Corporation Digital Interface Format (S/PDIF), or any other desired 
format that provides data packets associated with digital broadcasts. In that case, the 
audio/video content data is compressed digital audio data associated with audio/video 
content to which the decoder is currently tuned and which is being consumed via the 
output unit 128. 

[0032] In addition to its signal processing functions, the decoder 1 30 may also 
perform access control functions such as, for example, determining what programs are 
available for consumption by a user of the system 1 00 based on subscription status or 
subscription information associated with the system 1 00, generating displayable 
program guide information, etc. 

[0033] The site unit 132 processes the signals 136 received from the decoder 130 
to extract the inserted data (e.g., audience measurement data) therefrom. The site unit 
132 may then convey the extracted digital data (e.g., audience measurement data) to 
the central processing unit 124. The central processing unit 124 may process the 
extracted digital data to determine what audio/video content (e.g., chaimels and/or 
programs) Wcis consumed, the times at which the audio/video content was consumed, 
and/or the identities of those who consumed the audio/video content. In this maimer, 
the central processing unit 1 24 may generate viewing behavior information or 
statistics, ratings information or any other desired information relating to the 
consumption of audio/video content at the consumption site 1 1 0 or at one or more 
other consumption sites (none of which are shown). 

[0034] While the output unit 1 28, the decoder 1 30 and the site unit 1 32 are 
depicted in Fig. 1 as separate blocks, the functions performed by these blocks may be 
combined or integrated in any desired manner. For example, in the case where the 
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consumption site 1 1 0 is a portable device (e.g., a personal data assistant having a 
wireless communication interface), the functions performed by the blocks 128, 130 
and 132 may be integrated within the portable device. Alternatively, the functions 
performed by the output unit 128 and the decoder 130 may be integrated within the 
portable device, which is then periodically or continuously communicatively coupled 
to the site unit 1 32 to download its extracted data to the site vmit 1 32. In that case, the 
site unit 1 32 may be implemented as a base unit in which the portable device is 
periodically disposed to perform download operations. 

[0035] Fig. 2 is a block diagram of an example known system 200 that may be 
used by the digital broadcast station 102 of Fig. 1 to insert audience measurement data 
into one or more uncompressed audio/video content or program bitstreams. The 
system includes a plurality of data inserters 202, 204 and 206, each of which is 
configured to insert data into respective uncompressed audio/video content data 
streams 208, 210 and 212. Each of the streams 208, 210 and 212 contains a single 
audio/video program, which may be provided by a digital content provider similar or 
identical to the digital content providers 104 and 106 shown in Fig. 1 and/or which 
may be provided a local source such as, for example, a digital video recorder, a video 
cassette recorder, or any other suitable digital media delivery devices. 
[0036] The data inserters 202, 204 and 206 may be implemented using known data 
insertion devices such as vertical blanking inserters, watermarking encoders and 
closed caption encoders. The outputs of the data inserters 202, 204 and 206 are 
coupled to respective encoders 214, 216 and 218. The encoders 214, 216 and 218 are 
compression encoders that compress each of the individual audio/video content 
bitstreams (into which data has been inserted) using a known audio/video 
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compression scheme such as for example, a compression scheme compliant with the 
AC-3 and/or MPEG standards. 

[0037] The compressed audio/video content bitstreams output by the encoders 214, 
216 and 218 are multiplexed to form a single bitstream or transport stream by a 
multiplexer 220. The multiplexer 220 may multiplex the compressed bitstreams 
received from the encoders 214, 216 and 218 using a multiplexing scheme compliant 
with, for example, the ATSC and/or Digital Video Broadcast (DVB) standards. The 
multiplexer 220 provides its multi-program bitstream or transport stream to a 
modulator 222, which modulates the transport stream using known techniques, and a 
transmitter 224, which uses known techniques to transmit or broadcast the transport 
stream via, for example, the communication links 1 12 and 114 shown in Fig, 1 . 
[0038] The system 200 may also includes a Program and System Information 
Protocol (PSIP) generator 226, which uses well known techniques to generate a 
collection of hierarchically interlinked tables that contain information relating to the 
location of channels and programs, program scheduling (e.g., program lineup 
information), information facilitating the construction of program guides, as well as 
unique identifiers such as transport stream identifiers (TSIDs), each of which uniquely 
corresponds to a broadcaster. The PSIP generator 226 provides the PSIP information 
to the multiplexer 220, which multiplexes the PSIP information into the transport 
stream. 

In addition, the system 200 may include a data generator 228, which may 
provide interactive program information to the multiplexer 220, which multiplexes the 
interactive program information into the transport stream. For example, the data 
generator 228 may generate program information that may be used at a consumption 
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site (e.g., the consumption site 1 10 shown in Fig. 1) to generate a program grid-guide 
and/or to provide other user interface functionality at the consumption site. 
[0039] While the known system 200 of Fig. 1 enables audience measurement data 
to be inserted into individual audio/video program bitstreams, the inserted data may 
be corrupted or lost during the encoding or compression process performed by each of 
the encoders 214, 216 and 218. In addition, because the data inserters 202, 204 and 
206 insert audience measurement data without reference to the information being 
generated by the PSIP generator 226, changes in program lineup (e.g., reassignment 
of a program by a station to a different sub-channel, removal of a program, etc.) are 
not considered during the data insertion process. As a result, the inserted audience 
measurement data extracted at a consumption site may not reflect the programs or 
audio/video content actually consumed. To address this issue, two sets of metadata 
would have to be maintained to generate ratings information. In particular, one set of 
metadata associated with the inserted data and another set of metadata generated by 
the PSIP device (e.g., station or broadcaster metadata that is used for program 
identification). In addition, a mapping between the two sets of metadata would be 
required so that ratings information could ultimately be provided in terms the 
metadata generated by the PSIP device. Still further, the system 200 requires a 
separate data inserter for each program bitstream and, thus, may become overly 
complex in cases where the broadcast station (e.g., the broadcast station 102 of Fig. 1) 
multiplexes a large number of programs to form its transport stream or if a new 
charmel is introduced for transmission. 

{00401 Fig. 3 is a block diagram of an example system 300 that may be used 
within the digital broadcast station 102 of Fig. 1 to insert audience measurement data 
in a compressed audio/video content or program bitstream. Many of the functional 
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blocks shown in the system 300 of Fig. 3 are similar or identical to those shown and 
described in connection with Fig. 2. However, the system 300 interposes a data 
inserter 302 between the multiplexer 220 and the modulator 222, thereby eliminating 
the need for the plurality of data inserters 202, 204 and 206 (Fig. 2). In contrast to the 
data inserters 202, 204 and 206, the data inserter 302 operates in a compressed 
domain. In particular, the data inserter 302 inserts data (e.g., audience measurement 
data and/or other data) in a multi-program bitstream or transport stream that contains 
compressed audio/video data, PSIP information generated by the PSIP generator 226 
and/or other data generated by the data generator 228. 

As described in greater detail below, the data inserter 302 operates on a 
bitstream containing frames of data packets that are formatted using a predefined 
compression and transmission protocol. The data inserter 302 temporally packs or 
time shifts data within data frames to expand (i.e., increase the size of) a 
predetermined data area or location within one or more of the data frames and inserts 
audience measurement data within the one or more expanded predetermined data 
areas or locations. The inserted audience measurement data may then be extracted by 
one or more decoders at one or more consumption sites and reference sites and used 
to generate consumption records, verification information, program lineup 
information, viewing behavior information etc, 

[0041] Because the data inserter 302 operates in a compressed domain (i.e., it 
operates on bitstreams containing compressed data), the audience measurement data 
that it inserts cannot be corrupted or lost as a result of compression operations, as is 
the case with known systems (e.g., the known system 200 shown and described in 
connection with Fig. 2). In addition, because the data inserter 302 has access to the 
information generated by the PSIP generator 226, the data inserter 302 always inserts 
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audience measurement data that is consistent with the program lineup information 
contained with the PSIP tables provided by the PSIP generator 226. In this manner, 
the system 300 maintains two metadata systems (i.e., the metadata produced by the 
PSIP device and the metadata produced as a result of the data insertion process) that 
contain the same information. As a result, the system 300 provides audience 
measurement data that is more reliable than that provided by the known system 200 of 
Fig. 2, particularly in cases where the broadcast station 1 02 (Fig. 1) makes frequent 
changes to its program lineup. 

[0042] The system 300 may also include a data generator 304 that generates non- 
audience measurement data such as, for example, interactive data (e.g., unifomi 
resource locators (URLs), Internet protocol (IP) data, etc.), private or proprietary data, 
or any other non-audience measurement data. In one example, the data generator 304 
may generate data using the format shown below. 

Time Code: XX 

Minor Channel/Major Channel: XXA^ 

Data: http://xx.xx.xxx 
[0043] . The data generator 304 may be separate from the data inserter 302 as 
shown in Fig. 3, in which case the data generator 304 may. be communicatively 
coupled to the data inserter 302 via a communication link 306 such as for example, a 
serial interface, an Ethernet compatible link, or any other suitable communication 
link. Altematively, the data generator 304 may be integral with the data inserter 302. 
The data generator 304 may also be coupled to a user interface 306, which may 
include a keyboard, monitor, mouse, etc. that enable an operator to enter data to be 
inserted via the data generator 304 and the data inserter 302. 
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[0044] Now turning to Fig. 4, a more detailed block diagram depicts an example 
manner in which the data inserter 302 shown in Fig. 3 may be implemented- The 
example data inserter 302 includes a demultiplexer 400 that receives a multi-program 
bitstream (e.g., an ATSC compliant data stream) from the multiplexer 220 (Fig. 3). 
The demultiplexer 400 separates the multi-program bitstream into a plurality of 
bitstreams, including bitstreams containing compressed data associated with 
individual audio/video programs, a bitstream containing PSIP information, a bitstream 
containing data generated by the data generator 228, etc. 

[0045] A program information extractor 402 receives the individual bitstreams 
output by the demultiplexer 400 and extracts program information therefrom. In 
particular, the program information extractor 402 may extract a transport stream 
identifier, which uniquely corresponds to the broadcasting source (e.g., the station 102 
of Fig. 1) from which the multi-program bitstream was transmitted, major and minor 
channel information for each of the bitstreams corresponding to an audio/video 
program, date and time values for each of the audio/video program bitstreams, as well 
as any other desired program information. 

[0046] The audience measurement data generator 404 uses the extracted program 
information provided by the program information extractor 402 to generate audience 
measurement data for each of the audio/video program bitstreams contained within 
the multi-program bitstream received by the demultiplexer 400. The audience 
measurement data generator 404 may generate audience measurement data using the 
example syntax set forth in Table 1 below. 
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Data Field 


Length in bits 


AudienceMeasurementDatalD 


8 


PayloadStartlndex 


4 


Lenlndex 


4 


Payload 


Variable 



TABLE 1 



[0047] The data field AudienceMeasurementDatalD contains a unique identifier 
that may be used by decoders (e.g., the decoders 116, 118, 120, and 130) to identify 
audience measurement data and/or the audience measurement entity (e.g., a company) 
that has inserted the data. Such unique identifiers may be known in advance to 
facilitate the identification process. The data field PayloadStartlndex holds a value 
indicating the order in which audience measurement information is stored in the 
payload: One example manner in which the values of PayloadStartlndex may 
correspond to payload data organization is set forth in Table 2 below. 



PayloadStartlndex 


Payload Data Starts With 


0 


TransportID [bit 15-0] 


1 


Major channel [bit 1 5-0] 


2 


Minor channel [bit 1 5-0] 


3 


Time [bit 31-16] 


4 


Time [bit 15-0] 



TABLE 2 

[0048] The data field Lenlndex holds a value that indicates the length of the data 
field Payload. One example manner in which the data field Lenlndex may define the 
length of the data field Payload in set forth in Table 3 below. 
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Lenlndex 


Payload Length in Bytes 


0 


2 


1 


4 


2 


6 


3 


8 


4 


10 



TABLES 



[0049] Using the above example data field semantics set forth in Tables 1 through 
3, if PayloadStartlndex = 3 and Lenlndex = 3, then the payload contains eight bytes in 
the order set forth in Table 4 below. Thus, the Lenlndex data field enables 
modulation of the length of the inserted audience measurement data as a function of 
the number of bytes available in the inserted data location or placeholder. 



Payload Data 


No. of Bj^es 


Time [bit 31-16] 


2 


Time [bit 15-0] 


2 


Transport ID [bit 15-0] 


2 


Major Channel [bit 15-0] 


2 



TABLE 4 



[0050] Of course. Tables 1 through 4 above are merely one example manner in 
which the audience measurement data generator 404 may generate audience 
measurement data. Other data types and formats may be used to form audience 
measurement data for any desired application. For example, the Transport ID may be 
replaced by a proprietary identifier that is used by, for example, an audience 
measurement entity (e.g., a company) to identify a channel with a particular 
major/minor channel number. Alternatively, the Transport ID may be replaced with a 
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public content identifier such as, for example, an AD-ID or V-ISAN, which are well 
known content identification schemes. 

[0051] A data insertion unit 406 inserts the audience measurement data provided 
by the audience measurement data generator 404 in the individual bitstreams, which 
correspond to the individual audio/video programs provided by the demultiplexer 400. 
More specifically, the data insertion unit 406 packs or time shifts compressed data 
packets within the data frames of each audio/video program bitstream to expand a 
predetermined portion or data area of one or more data frames within those 
compressed data bitstreams. Audience measurement data pertaining to each of those 
audio/video bitstreams is inserted into one or more of the expanded predetermined 
portions or data areas. 

[0052] In addition to receiving audience measurement data to insert, the data 
insertion unit 406 may also receive other data such as, for example, non-audience 
measurement data to insert from the data generator 304 (Fig. 3). As described above, 
such non-audience measurement data may include interactive data such, for example 
URLs, applets, scripts, etc. Example syntax for such non-audience measurement data 
is set forth below in Tables 5 and 6. 



Data Field 


Value/Length 


Interactive Data Identifier 


OxBBH 


Data Length 


XX bytes 


Data Type 


YY 


Data 


ZZ 



TABLE 4 
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Data Type Value 


Data Type Description 


0 


URL 


1 


Scripts 


2 


Applets 



TABLE 5 



[0053] Audio/video bitstreams having data inserted therein by the data insertion 
unit 406 are provided to the program information modifier 408, which may, if needed, 
modify the program information associated with one or more of those bitstreams. In 
some cases, depending on where in the bitstream the data insertion unit 406 inserts the 
audience measurement data or other data, the program information associated with the 
bitstream into which the data has been inserted may have to be updated. For example, 
in the case where the program information includes PSIP and/or PSI table 
information, it may be necessary to modify the information the PSIP and/or PSI table 
information to reflect changes to reflect that private data has been inserted in the 
bitstream. 

[0054] After being processed by the program information modifier 408, a 
multiplexer 410 receives the individual bitstreams, including audio/video bitstreams 
into which audience measurement data and/or other data has been inserted by the data 
insertion unit 406. The multiplexer 410 also receives program information, which 
may have been modified via the program information modifier 408. For example, the 
multiplexer 41 0 may receive bitstreams containing modified PSIP information. Still 
other bitstreams may be received by the multiplexer 41 0 such as, for example, a 
bitstream containing other programs or data. In any event, the multiplexer 410 
multiplexes the plurality of bitstreams that it receives into a single multi -program 
bitstream or transport stream that may have substantially the same format (e.g., that is 
compliant with the same protocol) as the transport stream received by the 
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demultiplexer 400. However, the multi-program bitstream or transport stream output 
by the multiplexer 410 contains data inserted by the data insertion unit 406 and may 
contain program information modified by the program information modifier 408. 
10055] Fig. 5 is a more detailed block diagram depicting an example manner in 
which the data insertion unit 406 may be implemented. The data insertion unit 406 
may include a parser 500 that parses out or extracts a particular type or types of data 
packets to be passed to a time shifter 502. In one example, where data insertion unit 
406 is implemented within the digital broadcast station 102 of Fig. 1 and where the 
digital broadcast station 102 is configured to transmit ATSC compliant digital 
television signals, the parser 500 is configured to extract compressed audio data 
packets compliant with the AC-3 standard. In that example, the time shifter 502 is 
configured to time shift the compressed audio data packets within AC-3 data firames 
to reduce the number of or to eliminate skip bytes within the AC-3 data fi*ames. 
[0056] As is well known, compressed audio bitstreams compliant with the AC-3 
standard typically include ft-ames having one or more skip bytes, which are formed 
during the encoding process to maintain a fixed frame size for each AC-3 frame and 
which typically do not contain any usefiil infonmation. In addition, AC-3 data frames 
contain an auxiliary data field, which may be used to transmit information other than 
compressed audio data and/or may be used to fine tune the number of bits contained 
in a frame. However, in practice, the auxiliary data fields within AC-3 frames 
typically include few, if any, bytes. 

[0057] As noted above, the time shifter 502 reduces the number of or eliminates 
skip bytes within AC-3 frames and shifts audio data within the AC-3 frames to 
occupy the eliminated skip bytes. The result of the shifting is a packing of the 
compressed audio data toward one end of the frames to occupy portions of the frames 
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previously occupied by skip bytes, which effectively temporally shifts the audio data. 
Another result of this shifting is an increase in the number of bits available for the 
auxiliary data fields. 

[0058] An auxiliary data field inserter 504 inserts the audience measurement data 
generated by the audience measurement data generator 404 into the newly expanded 
auxiliary data fields of the AC-3 fi-ames. The inserted audience measurement data 
may be formatted as described above in connection with Tables 1 through 4 above, or 
in any other desired manner. Alternatively or additionally, non-audience 
measurement data provided by the data generator 304 (Fig. 3) may be inserted in the 
auxiliary data fields of the AC-3 fi-ames by the auxiliary data field inserter 504. 
[0059] After the audience measurement data and/or other data has been inserted in 
the newly expanded auxiliary data field of the AC-3 fi*ames, an error checking value 
generator 506 generates new error checking values for each AC-3 ft-ame. In this 
example, the error checking value generator 506 is configured to re-compute the 
cyclical redundancy check (CRC) values, which represent within each AC-3 fi^e. 
Re-computation of the CRC values for the AC-3 fi-ames is necessary because 
elimination of skip bytes, shifting compressed audio data and inserting data in the 
AC-3 fi-ame auxiliary data fields renders the original CRC values meaningless (i.e., 
the original CRCs are no longer representative of the data contained in the fi-ames). 
[0060] In general, the example data inserter 302 (Fig. 3) and data generator 304 
(Fig. 3) may be implemented using primarily hardware, primarily software or any 
desired combination of hardware and software. In the case of a primarily software- 
based implementation, a computer system or other processor system that executes 
machine readable instructions or programs may be used to implement the apparatus 
and methods described herein. The machine readable instructions or programs may be 
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embodied in software stored on a tangible medium such as a CD-ROM, a floppy disk, 
a hard drive, a digital versatile disk (DVD), or a memory. 

[0061] Fig. 6 is a block diagram of an example processor-based system 600 that 
executes software or instructions stored on a machine readable medium to implement 
the example data inserter 302 (Fig. 3) and/or the example data generator 304 (Fig. 3). 
The example processor-based system 600 includes a processor 602, which may be any 
suitable microprocessor such as, for example, a processor from the Intel Pentium® 
family of microprocessors. The processor 602 is communicatively coupled to a non- 
volatile memory 604 and a volatile memory 606. The non-volatile memory 604 may 
be implemented using, for example, electrically erasable programmable read only 
memory (EEPROM), read only memory (ROM), etc. The volatile memory 606 may- 
be implemented using, for example, static random access memory (SRAM), dynamic 
random access memory (DRAM), etc. The processor 602 is also coupled to a mass 
storage device 608, which may be implemented using, for example, a disk drive that 
stores digital information using a magnetic or optical media. 

[0062] The processor 602 retrieves and executes machine readable instructions or 
software programs that are stored on one or more of the memories 604 and 606 and/or 
the mass storage device 608 to perform the functions of the data inserter 302 and/or 
data generator 304 shown in Fig. 3. 

[0063] The processor 602 is also in communication with an input/output (I/O) unit 
610, that enables the system 600 to communicate with, for example, the user interface 
308 (Fig. 3). The I/O unit 610 may include circuitry for performing network 
communication fiinctions (e.g., Ethernet communication functions), phone line 
communication fimctions (e.g., modem fiinctions), peripheral device communication 
fimctions (e.g., universal serial bus communications, parallel port communications, 
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etc.) to enable the system 600 to communicate with one or more input devices such 
as, for example, a mouse, keyboard, etc. and/or one or more output devices such as, 
for example, a video display, a printer, etc. 

[0064] Fig. Visa flow diagram of an example manner in which the processor 
system 600 shown in Fig. 6 may be configured to perform the functions of the data 
inserter 302 shown in Fig. 3. Initially, the multi-program bitstream or transport 
stream received from the multiplexer 220 (Fig. 3) is demultiplexed into its constituent 
bitstreams (block 700). In particular, the transport stream may be separated into a 
plurahty of audio/video program bitstreams, a bitstream containing PSIP information, 
as well as other bitstreams containing other data and/or program information. 
Program information such as, for example, transport stream identifiers, major and 
minor channel numbers, date and time value, etc. are then extracted from the 
constituent bitstreams (block 702). The extracted program information is then used to 
generate audience measurement data (block 704), which is subsequently inserted in 
predetermined portions or data fields within the audio/video bitstreams (block 706). 
The program information may then be modified, if necessary, (block 708) and the 
constituent bitstreams, some of which have been modified via insertion of audience 
measurement data and/or modification of program information, are multiplexed to 
form a single transport stream (block 710). 

[0065] Fig. 8 is a more detailed flow diagram of an example manner in which the 
data insertion block 706 of Fig. 7 may be implemented. In particular, the audio/video 
bitstreams are parsed to extract certain data packets into which data will be inserted. 
In one example, as described above, audio data packets compliant with the AC-3 
standard are extracted. The audio data within the AC-3 data frames is time shifted to 
eliminate skip bytes within the frames (block 802), thereby increasing the number of 
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bits available to the auxiliary data field within one or more of the data frames. 
Audience measurement data, as well as other data, may then be inserted in the newly 
expanded auxiliary data field (block 804). The CRC for each AC-3 firame is then re- 
computed (block 806). 

[0066] Fig. 9 is a flow diagram of an example method by which the system 1 00 
shown in Fig. 1 may generate viewing behavior and ratings information using data 
inserted by the data inserter 302 of Fig. 3. Initially, the digital broadcast station 102 
(Fig. 1 ) inserts audience measurement data into its broadcast transport stream using, 
for example, the data inserter apparatus and methods described herein (block 900). 
One or more of the decoders 116, 1 18 and 120 (Fig. 1) together with the reference site 
processor 122 (Fig, 1) extract the audience measurement data fi*om known locations 
within the transmitted bitstreams (block 902). For example, in the case where the data 
inserted within the compressed audio bitstreams compliant with the AC-3, the known 
locations may be the auxiliary data fields of the AC-3 frames as described above. The 
reference site processor 1 22 (Fig. 1 ) uses the extracted audience measurement data to 
generate a program lineup (block 904). In particular, because the reference site 108 
(Fig. 1) can use its multiple decoders 116, 118 and 120 to receive and process 
multiple audio/video bitstreams simultaneously, the reference site processor 122 (Fig. 
1) can simultaneously detect and identify, using the inserted audience measurement 
data, a plurality of broadcast programs available for consumption. The reference site 
122 (Fig. 1) may then transmit the generated program lineup information to the 
collection site (block 906), which in this case is the central processing facility 124 
(Fig. 1). 

[0067] At the consumption site 1 10 (Fig. 1), the site unit 132 is configured to 
extract the inserted audience measurement data fi-om the signal 136 (block 908), 
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which, in one example, is an S/PDIF signal containing compressed audio data 
compliant with the AC-3 standard. In that case, the inserted audience measurement 
data is located in the auxiliary data fields of the AC-3 data frames and the site unit 
132 (Fig. 1) is configured to identify the auxiliary data fields and to extract 
information therefrom. The site unit 132 (Fig. 1) is also coupled to a people meter 
and/or other devices that enable the site unit 132 (Fig, 1) to generate demographic 
information (block 910). For example, the site unit 132 (Fig. 1) may be configured to 
detect the identities of the person or persons currently consuming an audio/video 
program via the output unit 128. In any event, the site unit 1 32 (Fig. 1 ) transmits the 
viewing behavior information (i.e., the audience measurement data, demographic 
information, etc.) to the collection site (block 912) (i.e., the central processing faciUty 
124 (Fig. D). 

[0068] The collection site or central processing facility 1 24 (Fig. 1) then compares 
the viewing behavior information received from the consumption site 110 (Fig. 1) to 
the program lineup information received fi-om the reference site 108 (Fig. 1) (block 
914). By matching the viewing behavior information to portions of the program 
lineup information, the collection site or central processing facility 124 (Fig. 1) may 
determine the time and manner in which audio/video programs were consumed at the 
consumption site 110 (Fig. 1) and/or other consumption sites (not shown) and by 
whom those audio/video programs were consumed. The matching information 
generated at block 914 may then be used by the central processing facility 124 (Fig. 1) 
to generate ratings information (block 916). 

[0069] In cases where the data generator 304 (Fig. 3) has provided non-audience 
measurement data (e.g., interactive data) to the data inserter 302 (Fig. 3), the decoder 
130 (Fig. 3) and/or site unit 132 (Fig. 3) may extract from the auxiliary data fields of 
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the AC-3 frames and process that non-audience measurement data. For example, the 
site unit 1 32 (Fig. 1) may include or be coupled to a web server (not shown) that 
enables activation of URLs and/or other interactive data. In some cases, the non- 
audience measurement data may be appropriately transcoded and conveyed via one or 
more wireless communication links to a portable devices such as, for example, a 
cellular phone, personal data assistant and/or a computer. 

[0070] Although the example data inserter 302 is depicted in Fig. 3 as being 
serially interposed between the multiplexer 220 and the modulator 222, other 
configurations may be used instead to achieve results identical or similar to those 
described above. Fig. 10 is a block diagram of another manner in which a data 
inserter 1000 may be configured to insert audience measurement data in a compressed 
audio/video content or program bitstream. As depicted in Fig. 10, the data inserter 
1 000 is communicatively coupled to the PSIP generator 226, one or more of the 
encoders 208, 210 and 212 and the multiplexer 220. In this configuration, the data 
inserter 1000 does not require a demultiplexer (e.g., the demultiplexer 400 of Fig. 4) 
or a multiplexer (e.g. the multiplexer 410 of Fig. 4). Still other configurations are 
possible. For example, the data inserter 1 000 may be integrated with the PSIP 
generator 226 and/or one of more of the encoders 208-21 2. 

[0071] While the data insertion apparatus and methods described herein have been 
described with reference to specific examples, the apparatus and methods may be 
implemented in different manners to achieve identical or similar results. More 
specifically, although example methods and apparatus may time shift compressed 
audio data within AC-C compliant data frames to expand the number of bits available 
for AC-3 frame auxiliary data fields, into which data may be inserted, other insertion 
techniques may be used instead. For example, audience measurement data and/or 
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Other data may be inserted in private descriptors such as, for example, the ATSC 
private descriptor, the MPEG-2 metadata descriptor and/or the MPEG-2 private 
descriptor in Program System Information (PSI) tables (e.g., the program loop that is 
present in a program map table (PMT) section). Alternatively or additionally, the 
audience measurement data and/or other data may be inserted in Event Information 
Tables (EITs), A-90 data packets and/or null or padding packets to achieve identical 
or similar results. 

[0072] Although certain methods, apparatus and articles of manufacture have been 
described herein, the scope of coverage of this patent is not limited thereto. To the 
contrary, this patent covers all embodiments including apparatus, methods and articles 
of manufacture fairly falling within the scope of the appended claims either literally 
or under the doctrine of equivalents. 
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What is claimed is: 

1 . A method of inserting data in a compressed data bitstream, comprising: 
time shifting first data in a first portion of the compressed data bitstream to 

increase a size of a second portion of the compressed data bitstream; and 

inserting second data in the second portion of the compressed data bitstream to 
form a modified compressed data bitstream. 

2. A method as defined in claim 1, wherein time shifl:ing the first data includes 
moving the first data to occupy a data location from which third data was eliminated. 

3. A method as defined in claim 2, wherein the third data includes a skip byte. 

4. A method as defined in claim 1 , further comprising selecting data packets 
associated with the compressed data bitstream from a multi-program bitstream. 

5. A method as defined in claim 4, wherein the data packets contain compressed 
audio information. 

6. A method as defined in claim 1 , wherein the first portion of the compressed 
data bitstream is a data frame, the second data is compressed audio data and the 
second portion of the compressed data bitstream is an auxiliary data field. 

7. A method as defined in claim 6, wherein the compressed data bitstream is 
compliant with an AC-3 format. 

8. A method as defined in claim 1, wherein the second data includes at least one 
of audience measurement data and interactive data. 
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9. A method as defined in claim 1 , wherein the compressed data bitstream 
contains a plurahty bitstreams. 

1 0. A method as defined in claim 9, wherein the plurality of bitstreams includes a 
plurality of audio/video program bitstreams. 

11. A method as defined in claim 1 , further comprising re-computing an error 
checking value associated with the second portion of the compressed data bitstream 
after inserting the second data in the second portion of the compressed data bitstream. 

1 2. A method as defined in claim 1 1 , wherein the error checking value is a 
cyclical redundancy check value. 

13. A method as defined in claim 1 , fiirther comprising broadcasting the modified 
composed data bitstream. 

1 4. A method as defined in claim 1 , further comprising demultiplexing the 
compressed data bitstream to identify a plurality of bitstreams. 

15. A method as defined in claim 1 4, fiirther comprising extracting program 
information fi-om at least one of the plurality of bitstreams 

1 6. A method as defined in claim 1 5, fiarther comprising generating audience 
measurement data fi*om the program information 

1 7. A method as defined in claim 1 6, wherein the second data includes the 
audience measurement data. 
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1 8. A system for inserting data in a compressed data bitstream, comprising: 
a memory; and 

a processor coupled to the memory and progranmied to: 

time shift first data in a first portion of the compressed data bitstream 

to increase a size of a second portion of the compressed data bitstream; and 

insert second data in the second portion of the compressed data 

bitstream to form a modified compressed data bitstream. 

19. A system as defined in claim 1 8, wherein the processor is programmed to time 
shift the first data by moving the first data to a location fi-om which third data has 
been eliminated. 

20. A system as defined in claim 19, wherein the third data includes a skip byte. 

21 . A system as defined in claim 18, wherein the processor is programmed to 
select data packets associated with the compressed data bitstream fi-om a multi- 
program bitstream. 

22. A system as defined in claim 21, wherein the data packets contain compressed 
audio information. 

23. A system as defined in claim 18, wherein the first portion of the compressed 
data bitstream is a data frame, the second data is compressed audio data and the 
second portion of the compressed data bitstream is an auxiliary data field. 

24. A system as defined in claim 23, wherein the compressed data bitstream is 
compliant with an AC-3 format. 
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25. A system as defined in claim 1 8, wherein the second data includes at least one 
of audience measurement data and interactive data. 

26- A system as defined in claim 1 8, wherein the compressed data bitstream 
contains a plurality bitstreams. 

27. A system as defined in claim 26, wherein the plurality of bitstreams includes a 
plurality of audio/video program bitstreams. 

28. A system as defined in claim 1 8, wherein the processor is programmed to re- 
compute an error checking value associated with the second portion of the 
compressed data bitstream after inserting the second data in the second portion of the 
compressed data bitstream. 

29. A system as defined in claim 28, wherein the error checking value is a cyclical 
redundancy check value. 

30. A system as defined in claim 1 8, wherein the processor is programmed to 
demultiplex the compressed data bitstream to identify a plurality of bitstreams. 

31. A system as defined in claim 30, wherein the processor is programmed to 
extract program information from at least one of the plurality of bitstreams 

32. A system as defined in claim 3 1 , wherein the processor is programmed to 
generate audience measurement data fi*om the program information 

33. A system as defined in claim 32, wherein the second data includes the 
audience measurement data. 

34 



wo 2004/038538 



PCT/US2003/028037 



34. A machine readable medium having instructions stored thereon that, when 
executed, cause a machine to: 

time shift first data in a first portion of a compressed data bitstream to increase 
a size of a second portion of the compressed data bitstream; and 

insert second data in the second portion of the compressed data bitstream to 
form a modified compressed data bitstream. 

35. A machine readable medium as defined in claim 34 having instructions stored 
thereon that, when executed, cause the machine to time shift the first data by moving 
the first data to a location ft-om which third data has been eliminated. 

36. A machine readable medium as defined in claim 35, wherein the third data 
includes a skip byte. 

37. A machine readable medium as defined in claim 34 having instructions stored 
thereon that, when executed, cause the machine to select data packets associated with 
the compressed data bitstream fi-om a multi-program bitstream. 

38. A machine readable medium as defined in claim 37, wherein the data packets 
contain compressed audio information. 

39. A machine readable medium as defined in claim 34, wherein the first portion 
of the compressed data bitstream is a data fi-ame, the second data is compressed audio 
data and the second portion of the compressed data bitstream is an auxiliary data field. 

40. A machine readable medium as defined in claim 39, wherein the compressed 
data bitstream is compliant with an AC-3 format. 
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41 . A machine readable medium as defined in claim 34, wherein the second data 
includes at least one of audience measurement data and interactive data, 

42. A machine readable medium as defined in claim 34, wherein the compressed 
data bitstream contains a plurality bitstreams. 

43- A machine readable medium as defined in claim 42, wherein the plurality of 
bitstreams includes a plurality of audio/video program bitstreams. 

44. A machine readable medium as defined in claim 34 having instructions stored 
thereon that, when executed, cause the machine to re-compute an error checking value 
associated with the second portion of the compressed data bitstream after inserting the 
second data in the second portion of the compressed data bitstream. 

45. A machine readable medium as defined in claim 44, wherein the error 
checking value is a cyclical redundancy check value. 

46. A machine readable medium as defined in claim 34 having instructions stored 
thereon that, when executed, cause the machine to demultiplex the compressed data 
bitstream to identify a plurality of bitstreams. 

47- A machine readable medium as defined in claim 46 having instructions stored 
thereon that, when executed, cause the machine to extract program information from 
at least one of the plurality of bitstreams 

48. A machine readable medium as defined in claim 47 having instructions stored 
thereon that, when executed, cause the machine to generate audience measurement 
data fi-om the program information 
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49. A machine readable medium as defined in claim 48, wherein the second data 
includes the audience measurement data. 

50. A data inserter, comprising: 

a parser to select predetermined types of data packets from a compressed data 
bitstream; 

a time shifter to time shift compressed data to occupy the locations from 
which a first type of data is eliminated; and 

an inserter to insert a second type of data into a predetemiined location of the 
compressed data bitstream that increases in size as a result of time shifting the 
compressed data. 

51. A data inserter as defined in claim 50, further comprising an error checking 
value generator to re-compute an error checking value after the second type of data 
has been inserted into the predetermined location of the compressed data bitstream. 

52. A data inserter as defined in claim 5 1 , wherein the error checking value is a 
cycUcal redundancy check value. 

53. A data inserter as defined in claim 50, wherein the compressed data bitstream 
includes compressed audio data and wherein the predetermined types of data packets 
include audio information. 

54. A data inserter as defined in claim 53, wherein the predetermined types of data 
packets are compliant with an AC-3 format. 
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55. A data inserter as defined in claim 50, wherein the first type of data includes 
skip bytes and wherein the predetermined location of the compressed bitstream 
includes an auxiliary data field. 

56. A data inserter as defined in claim 50, wherein the second type of data 
includes at least one of audience measurement data and interactive data. 

57. A digital broadcast stafion, comprising: 
a multiplexer; 

an encoder coupled to the multiplexer; and 

a data inserter coupled to the multiplexer, wherein the data inserter is 
configured to time shift a first type of data within a compressed bitstream generated 
by the encoder and to insert a second type of data into a predetermined location within 
the compressed bitstream that increases in size as a result of time shifting the first 
type of data. 

58. A digital broadcast station as defined in claim 57, wherein the encoder is 
configured to compression encode audio/video programs. 

59. A digital broadcast station as defined in claim 58, wherein the encoder is 
configured to compression encode audio/video programs in accordance with a digital 
television broadcast standard. 

60. A digital broadcast station as defined in claim 57, wherein the first type of 
data includes skip bytes and wherein the predetermined location within the 
compressed bitstream includes an auxiliary data field. 
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61. A digital broadcast station as defined in claim 57, wherein the data inserter is 
configured to re-compute an error checking value within the compressed bitstream 
following insertion of the second type of data into the predetermined location. 

62. A digital broadcast station as defined in claim 57, wherein the second type of 
data includes at least one of audience measurement data and interactive data. 

63. A digital broadcast station as defined in claim 57, further comprising a data 
generator coupled to the data inserter to generate interactive data. 

64. A digital broadcast station as defined in claim 63, further comprising a user 
interface coupled to the data generator. 

65. A method of generating ratings information, comprising: 

inserting audience measurement data in a compressed bitstream by eliminating 
a first type of data within the compressed data bitstream, time shifting a second type 
of data to occupy locations within the compressed data bitstream fi-om which the first 
type of data is eliminated and inserting the audience measurement data in a 
predetermined location within the compressed data bitstream that is expanded as a 
result of time shifting of the second type of data to fomi a modified compressed data 
bitstream; and 

generating the ratings information based on the modified compressed data 
bitstream. 
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66. A method as defined in claim 65, wherein generating the ratings information 
based on the modified compressed data bitstream comprises: 

receiving the audience measurement data extracted at a first location to 
generate program lineup information; 

receiving the audience measurement data extracted at a second location to 
generate consumption information; and 

comparing the program lineup information to the consumption information to 
generate the ratings information. 

67. A method as defined in claim 65, wherein the compressed data bitstream 
includes at least one audio/video program and wherein the first type of data includes 
skip bytes, the second type of data includes compressed audio/video content and the 
predetermined location is an auxiliary data field. 

68. A method as defined in claim 67, wherein the compressed data bitstream is 
AC-3 compliant. 

69. A method of transmitting interactive data, comprising: 

inserting interactive data in a bitstream by eliminating a first type of data 
within the bitstream, time shifting a second type of data to occupy locations within the 
bitstream fi*om which the first type of data is eliminated and inserting the audience 
measurement data in a predetermined location within the bitstream that is expanded as 
a result of the time shifting of the second type of data to form a modified bitstream; 
and 

transmitting the modified bitstream. 
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70- A method as defined in claim 69, wherein the bitstream includes at least one 
audio/video program and wherein the first type of data includes skip bytes, the second 
type of data includes compressed audio/video content and the predetermined location 
is an auxiliary data field. 

71 . A method as defined in claim 70, wherein the bitstream is AC-3 compliant 



41 



wo 2004/038538 



PCT/US2003/028037 



1/10 



100 



128 



110 



134 



104 



DIGITAL 
CONTENT 
PROVIDER 



102 



DIGITAL 
CONTENT 
PROVIDER 



DIGITAL 
BROADCAST 
STATION 



106 



108 



116 





112 



124 



DECODER 



118 



DECODER 



OUTPUT UNIT 



130 



DECODER 



114 



122 





SITE UNIT 



136 




r 



132 



126 



DATABASE 



120 



DECODER 



FIG. 1 



Page Blank (uspfo] 



wo 2004/038538 PCT/US2003/028037 



2/10 



200 



202 



214 



208 



210 



212 




220 



224 




222 



FIG. 2 
(PRIOR ART) 



'on'f (uspto, 



wo 2004/038538 



PCT/US2003/028037 



3/10 



300 



202 



208 



210 



212 




220 



MUX 



224 



302 



DATA 




INSERTER 






306 



MODULATOR 



222 



DATA 1/ 
GENERATOR 



304 



USER 
INTERFACE 



308 



FIG. 3 



e 



wo 2004/038538 



PCT/US2003/028037 



4/10 




O 
CO 




o 



IN 










o 


DIENC 

UKtlVl 


DATA 


ERAT( 








< 




LU 


^ LU 




o 


2 






This Page Blank fuspto 



wo 2004/038538 



PCT/US2003/028037 



5/10 



CD 
O 



CO 

o 



o 








CHECKI 


LUE 
RATOR 


< LU 


q: > 2 


o 


LU 




O 






LU 





o 



Q 




_J 




LU 




LJL 


LU 


TA 


RT 


< 


LU 


Q 


CO 


X 




ZD 




< 






This Page B!a* JysD?"" 



wo 2004/038538 



PCT/US2003/028037 



6/10 



r 



600 



602 



PROCESSOR 



604 



NON-VOLATILE 
MEMORY 



VOLATILE 
MEMORY 



606 



608 



MASS 
STORAGE 



610 



I/O 



FIG. 6 



This Page Blank (usp' 't 



wo 2004/038538 



PCT/US2003/028037 



7/10 



START 



I 



3 



DEMUX 
BITSTREAM 



I 



EXTRACT 
PROGRAM 
INFORMATION 



I 



GENERATE 
AUDIENCE 
MEASUREMENT 
DATA 



MODIPf 
PROGRAM 
INFORMATION 



I 



700 



702 



704 




706 



708 



MULTIPLEX 
INFORMATION TO 
REGENERATE 
BITSTREAM 



c 



I 



710 



RETURN/END 



FIG. 7 



( 



This Page Blank (ust) 



wo 2004/038538 



PCT/US2003/028037 



8/10 



C 



START 



3 



PARSE DATA 



I 



TIME SHIFT DATA 



800 



802 



INSERT DATA IN 
EXPANDED DATA 
LOCATION(S) 



I 



RE-COMPUTE 
CRCs 



804 



806 



c 



RETURN 



FIG. 8 



This Page Blank lusp " 



wo 2004/038538 



PCT/US2003/028037 



9/10 



902 



904 



906 



^ START ^ 



INSERT AUDIENCE 
MEASUREMENT DATA AT 
BROADCAST STATION 



900 



EXTRACT AUDIENCE 
MEASUREMENT DATA AT 
REFERENCE SITE 



I 



EXTRACT AUDIENCE 
MEASUREMENT DATA AT 
HOME SITE 



GENERATE PROGRAM 
LINEUP AT REFERENCE 
SITE 



I 



I 



r 



908 



GENERATE 
DEMOGRAPHIC 
INFORMATION 



910 



TRANSMIT PROGRAM 
LINEUP INFORMATION TO 
COLLECTION SITE 




TRANSMIT VIEWING 
BEHAVIOR INFORMATION 
TO COLLECTION SITE 









i 



r 



912 



PERFORM MATCHING AT 
COLLECTION SITE 


1 — 914 


\ 


r 




GENERATE RATINGS 
INFORMATION 


1 — 916 




r 





Return/end) 



FIG. 9 



wo 2004/038538 



10/10 



PCT/US2003/028037 



226 



220 





PSIP 






GENERATOR 


► 




t 




1000 — V 


DATA 




► 




INSERTER 





208-212 




FIG. 10 



This Page Wm^i 



